Repository navigation
model: add Beam (Reflection) - #30670
Merged
Merged
Conversation
github-actions
Bot
added
model
Contributor
Author
|
GGUFs at https://huggingface.co/unsloth/Beam-1.0-501B-A23B-GGUF for those wanting to try them! |
CISC
approved these changes
Oct 16, 2026
CISC
marked this pull request as ready for review
October 16, 2026 13:41
ngxson
approved these changes
Oct 16, 2026
Member
|
The CUDA error is transient, will merge after all the remaining checks are OK. |
6 tasks
fewtarius
added a commit
to SyntheticAutonomicMind/llama.cpp
that referenced
this pull request
Oct 18, 2026
Problem: The merge of master into unstable (1f6790b) resolved conflicts in favor of losing parts of the Kolibri-1 (ggml-org#30673) and Beam (ggml-org#30670) commits. This caused two categories of damage: 1. Missing enum value (llama-model.h): LLM_TYPE_78B_A3_5B was absent from the llm_type enum, causing kolibri1.cpp to fail compilation with 'use of undeclared identifier'. 2. Missing model dispatch and layer fields (Beam): llama_model_beam struct was absent from models.h, wqkv_gate_b was absent from llama_layer, pattern_attn_gate_bias was absent from its declaration in llama-model.cpp, and the granularity_head split check for attn_gate_bias was absorbed into the sinks branch. All five missing pieces are restored to match upstream commit state.
3 of 6 tasks
auRose94
pushed a commit
to auRose94/llama.cpp
that referenced
this pull request
Oct 28, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds support for Reflection's
Beam-1.0-501B-A23B(HFBeamForCausalLM): converter, model graph and a chat parser for its tool-call format. Opening as a draft because the weights are not public yet, so the real-model results below cannot be reproduced from outside at the moment.Architecture
build_moe_ffn; correction bias used for selection only, routed scale and normalised weights required in the GGUFllm_graph_input_attn_temp, off by defaultsrc/models/beam.cpp<|channel|>+<|constrain|>xml+rfl:parameter)harmony-xmlchat parser, detected only when all three markers are presentNo new ggml op.
Correctness
test-llama-archs -a beam: OK on CPU, CUDA and Meta.test-chat,test-jinjapass.apply_chat_template; multi-turn tool-call sessions (parallel calls, typed and nested arguments, long logs) pass end to end throughllama-server.Effect on other architectures
llama-graph.cpp: the power-law temperature is a separate branch; existing users take the old path.llm_graph_input_attn_tempgains a shape-onlycan_reuse, sinceset_inputrecomputes the scale every ubatch.llama-vocab.cpp: Beam's</s>stays a normal token (it is plain text in its tokenizer), using the existing gemma4/plamo exception keyed on a Beam-only token. Token ids, EOG sets and attributes are unchanged on 19 upstream test vocabs and 224 local GGUFs.common/jinja: thelistfilter accepts objects (returns the keys).common/chat.cpp: the new parser is only selected for templates containing all three markers.AI Usage
Used Claude and Local Models for testing, iteration and code design - manual verification of model / PR usage